🕷️️ Job Radar • SCRAPING

upwork.com 🟢 2026-05-14

🔹 Refactor raw job descriptions into a structured Technical Manifest (JSON)
👤 Client: 🇺🇸 United States Member since 2022-05-03
💰 Price: ****
🚩 Problem: Organize and structure data from faculty reviews for 15,000 STEM faculty members.
📦 Existing: Not specified

Specifications:

[Target] Compile publicly available faculty review data from RateMyProfessor.com
[Method] Use web scraping tools like Lulzasaur RateMyProfessors Scraper or ParseForge Rate My Professors Scraper
[UI/UX] Not applicable
[Stack] Python, BeautifulSoup, Pandas, Google Sheets API
[Security] Ensure data privacy and compliance with website terms of service; use secure scraping practices
[Format] JSON for structured output

Workflow:

1. Obtain a spreadsheet containing faculty names, email addresses, college names, and disciplines.
2. Match each faculty member to their corresponding RateMyProfessor.com profile using provided details.
3. Extract publicly available data from profiles including overall rating, difficulty rating, number of ratings, tags/attributes, and student reviews.
4. Organize extracted data into a structured JSON format with fields: Faculty Name, College, Discipline, Rate My Professors Profile URL, Overall Rating, Difficulty Rating, Number of Ratings, Tags/Attributes, Student Reviews, Review Dates, Course Names, Student Sentiment/Tags.